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Abstract. 

Medical image denoising is the process of removing noise from medical 
images while preserving the underlying diagnostic information. Classical 
denoising techniques have been widely used in medical image denoising. 
However, they have limitations in handling complex noise patterns and 
preserving fine details in the images. In recent years, deep learning-based 
methods have emerged as a promising approach for medical image 
denoising. These methods leverage the power of deep neural networks to 
learn the underlying patterns in the images and remove noise while 
preserving the diagnostic information. This survey paper provides a 
comprehensive review of the types of noise in medical images and the 
classical denoising methods. We also review the recent developments in 
deep learning-based methods for medical image denoising and the 
evaluation metrics used to assess their performance. Furthermore, we 
discuss the challenges in medical image denoising and the future directions 
in this field. The aim of this paper is to provide a comprehensive overview of 
the state-of-the-art in medical image denoising and to highlight the 
challenges and opportunities for future research in this field. 
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1. Introduction 


Medical imaging is a crucial tool in modern healthcare, providing clinicians 
with non-invasive methods for diagnosing and monitoring various medical 
conditions. However, medical images are often corrupted by noise, which 
can reduce the accuracy and reliability of the information contained within 
them. Image denoising is therefore a critical step in the processing of 
medical images, aimed at removing unwanted noise while preserving the 
underlying image structure [1-3]. 

Medical imaging techniques such as X-rays, CT scans, MRI, and ultrasound 
provide detailed and accurate images of internal organs and structures, 
helping medical professionals to identify and diagnose diseases, injuries, 
and other abnormalities. However, the accuracy of medical image 
processing depends on the quality of the image data and the effectiveness of 
the image processing techniques used. Poor image quality or inaccurate 
processing can lead to misdiagnosis, delayed treatment, or even serious 
health risks for patients. Therefore, it is essential to ensure that medical 
images are processed accurately and efficiently to enable accurate 
diagnosis and treatment planning. Advances in image processing 
techniques, including deep learning-based approaches, have the potential to 
improve the accuracy and speed of medical image processing, leading to 
better patient outcomes [4-6]. 

Classical denoising techniques have been widely used in medical image 
processing to remove noise and improve image quality. These techniques 
include filtering, transform-based methods, and other mathematical models. 
While these methods have been successful in reducing noise, they have 
some limitations. Filtering, for example, can remove noise but also blur 
edges and detail in the image. Transform-based methods can preserve 
edges and details, but they may introduce artifacts and distortions in the 
image [7]. Furthermore, classical denoising techniques are often limited by 


the complexity and variability of medical images, which can make it 


challenging to find a suitable model or algorithm for each image [8-10]. 
Therefore, there is a need for more advanced and adaptive denoising 
methods that can handle a wide range of noise types and levels while 
preserving image details and accuracy. This has led to the development of 
deep learning-based denoising methods, which have shown promising 
results in medical image processing. 

In recent years, deep learning-based methods have emerged as a powerful 
approach for medical image denoising [11-13]. Deep learning is a machine 
learning technique that uses artificial neural networks to learn complex 
patterns and relationships from large datasets. Deep learning-based 
denoising methods leverage this approach to learn the underlying structure 
of medical images and remove noise while preserving image details and 
accuracy. Convolutional neural networks (CNNs) [14] and generative 
adversarial networks (GANs) [15] are two popular types of deep learning 
models used for medical image denoising. CNN-based methods use a series 
of convolutional layers to extract features from the input image and reduce 
noise, while GAN-based methods generate realistic and denoised images by 
training a generator and discriminator network. Deep learning-based 
methods have shown significant improvements in denoising performance 
compared to classical methods and have the potential to revolutionize 
medical image processing. However, challenges such as the need for large 
training datasets and interpretability of the results still need to be 
addressed to fully realize the potential of deep learning-based methods for 
medical image denoising. 

The main objective of this survey paper is to provide an overview of the 
current state-of-the-art in medical image denoising techniques, with a focus 
on deep learning-based methods. The paper aims to provide a 
comprehensive understanding of the challenges and opportunities in 
medical image denoising and to compare the performance of classical and 
deep learning-based methods. Specifically, the paper will review the 


different types of noise in medical images and their effects on image quality 
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and diagnostic accuracy. It will also provide an overview of classical 
denoising techniques and their limitations, as well as the emergence of 
deep learning-based methods for medical image denoising. The paper will 
compare of different deep learning-based models and discuss the challenges 
and opportunities in this area of research. Finally, the paper will highlight 
the importance of accurate medical image processing for diagnosis and 
treatment and provide recommendations for future research in this field. 
Overall, the survey paper aims to provide a comprehensive and informative 
resource for researchers, clinicians, and practitioners interested in medical 
image denoising. 

This article is presenting in six sections. In the second part, discussing 
the different types of noise that can corrupt medical images presented. 
The third section introduces the classical medical denoising methods. In 
the fourth section, the various deep learning-based methods that have 
been developed for medical image denoising are analyzing. In the fifth 
section, we will also review the evaluation metrics that are commonly 
used to assess the performance of these methods. Finally, in last section, 
we will suggest future directions for research in this field and conclusion 


are presented. 


2. Types of noise in medical images 


Medical images are often affected by various forms of noise, which can be 
caused by a variety of factors. One of the most common types of noise is 
electronic noise, which is caused by the inherent limitations of the imaging 
equipment. Electronic noise can manifest as Gaussian noise, which is 
random and can affect the entire image, or as salt-and-pepper noise, which 
appears as isolated bright and dark pixels. Another common source of noise 
in medical images is Poisson noise, which is caused by the random nature of 


photon interactions with the imaging sensor. This type of noise is often 


more prevalent in low-dose imaging and can affect the image contrast and 
clarity. 

Patient motion is another factor that can contribute to noise in medical 
images. Motion artifacts can occur when the patient moves during image 
acquisition, resulting in blurred or distorted images. Motion artifacts can 
also be caused by breathing or other physiological processes, which can 
cause changes in image intensity or contrast. Other types of artifact noise in 
medical images include ringing artifacts, which can occur due to limitations 
in the imaging equipment, and aliasing artifacts, which can occur when the 
imaging frequency is too low. 

The presence of noise in medical images can have a significant impact on 
the accuracy of diagnosis and treatment. Therefore, it is essential to 
understand the different sources of noise in medical images and their 
effects on image quality. Furthermore, noise reduction techniques should be 
tailored to the specific type of noise present in the image to avoid 
introducing additional artifacts or distortions. Rician noise is another noise 
model used in medical denoising research, which is characterized by a 
combination of Gaussian and Poisson noise. This type of noise is often 
encountered in magnetic resonance imaging (MRI) and can result in a loss 
of image contrast and detail. In addition, salt-and-pepper noise is a type of 
noise model that is characterized by isolated bright and dark pixels, which 
can be caused by errors in the imaging equipment or data transmission. 
Noise is a major concern in medical imaging as it can have a detrimental 
effect on image quality, leading to difficulties in accurate diagnosis and 
treatment. The presence of noise can obscure important features, reduce 
clarity and sharpness, and impact contrast, making it challenging to 
distinguish between normal and abnormal tissue. Medical imaging 
modalities that require high precision, such as MRI and CT, are particularly 
vulnerable to noise, which can compromise diagnostic accuracy and patient 
outcomes. To address this issue, effective noise reduction techniques are 


essential. 


Rayleigh noise Motion artifacts noise Aliasing artifacts noise Speckle noise 


Fig 1. Types of noise in medical images 


Fig 2, different types of noise and their corresponding effects are 
showcased, comprising: 
Gaussian noise, Salt and pepper noise, Poisson noise, Rayleigh noise, 


Motion artifacts noise, Aliasing artifacts noise, Speckle noise. 


3. Classical medical imaged noising techniques 


Classical medical image denoising methods refer to techniques that have 
been used for many years to reduce noise in medical images. These 
techniques typically involve a series of steps that aim to reduce noise while 


preserving important details in the image that are shown in Fig 2. 


Fig 2. The structure of classical medical image denoising 


The first step in denoising medical images involves preprocessing the image 
to prepare it for the denoising algorithms. This may include resizing, 
cropping, or normalizing the image. Before applying denoising algorithms, 
it is important to estimate the type and level of noise present in the medical 
image. This can be done using statistical methods or by analyzing the 
image's frequency content. Once the noise is estimated, various filtering 
techniques are applied to remove the noise while preserving the underlying 
image details. After denoising, post processing techniques can be applied to 


further enhance the image quality. This may involve contrast enhancement, 


sharpening, or edge detection algorithms. It's important to note that the 
specific algorithms and techniques used in classical medical image 
denoising may vary depending on the specific application and the type of 
noise present in the image. 

Classical medical image denoising methods can be broadly classified into 
two categories: spatial domain and frequency domain techniques. 

Spatial domain techniques involve manipulating the pixel values of an image 
directly. One of the most commonly used spatial domain methods is the 
median filter, which replaces each pixel value with the median value of its 
neighborhood. Another popular spatial domain method is the Wiener filter, 
which uses a statistical model of the noise present in the image to estimate 
the original signal. These methods are simple and computationally efficient, 
but they can lead to loss of detail and blurring of edges. 

Frequency domain techniques, on the other hand, involve transforming the 
image into the frequency domain using techniques such as Fourier 
transform or wavelet transform. In the frequency domain, noise can be 
filtered out by removing high-frequency components. One of the most 
commonly used frequency domain methods is the low-pass filter, which 
removes high-frequency noise while preserving low-frequency detail in the 
image. However, these methods can also result in loss of detail and blurring 
of edges. 

Classical medical image denoising methods have been widely used for many 
years and are still used in some applications today. Advantages of classical 
methods for medical image denoising: 

1. Simplicity: Classical methods are often simple and easy to implement, 
making them accessible to researchers and clinicians with limited 
computational resources. 

2. Computational efficiency: Many classical methods are computationally 


efficient, allowing for real-time processing of large datasets. 


3. Interpretability: Classical methods are often intuitive and easy to 
interpret, making it easier to understand the changes made to an image 
during the denoising process. 

4. Robustness: Classical methods can be robust to variations in image 
quality, making them useful for denoising images acquired with different 
imaging modalities or under varying conditions. 

Limitations of classical methods for medical image denoising: 

1. Loss of detail: Classical methods can lead to loss of detail and blurring of 
edges in the denoised image, reducing the diagnostic accuracy of the 
image. 

2. Limited noise reduction: Classical methods may not be able to effectively 
remove all types of noise present in the image, leading to residual noise and 
reduced image quality. 

3. Limited adaptability: Classical methods are often designed to work with 
specific types of noise or imaging modalities and may not be adaptable to 
other types of noise or imaging modalities. 

4. Lack of automation: Classical methods often require manual parameter 
tuning and may not be fully automated, making them more time-consuming 
and less efficient than automated methods. 

Here are some examples of popular techniques used in classical medical 
image denoising: 

e Filtering techniques: These techniques involve applying a filter to the 
image to remove noise. Common filtering techniques include the 
median filter, mean filter, and Gaussian filter. Papers [16] to [18] are 
samples from these techniques. 

e Transform-based methods: These methods involve applying a 
transform such as wavelet to the image to decompose it into different 
frequency components. The high-frequency components, which 
contain noise, are then removed, and the image is reconstructed. 


Papers [19] to [21] are examples from these techniques. 


Principal component analysis (PCA) denoising: This method involves 
projecting the image onto a lower-dimensional subspace and filtering 
out the high-frequency components. Papers [22] and [23] are samples 
from these techniques. 

Hybrid methods: These methods offer the advantage of combining 
multiple denoising techniques to achieve better noise reduction while 
preserving important image details. These methods can be tailored to 
specific applications and types of noise to optimize the denoising 
process. Papers [24] to [26] are examples from these techniques. 
Non-local Means (NLM): NLM exploits redundancies in natural 
images to preserve textures and fine details. However, it can be 
computationally intensive and sensitive to parameter tuning, 
particularly with high noise levels. 

Total Variation (TV) Denoising: TV denoising methods preserve edges 
and are effective for piecewise constant images. However, they may 
produce staircase artifacts and have limited effectiveness with 
textured images or varying noise levels. 

Anisotropic Diffusion: These methods preserve edges and are robust 
to noise with simple implementation. However, they may blur textures 
and fine details and are sensitive to parameters, leading to slow 
convergence. 

Block-Matching and 3D Filtering (BM3D): BM3D is effective for 
volumetric images like CT scans and preserves textures and fine 
details. However, it is computationally intensive and requires careful 
parameter tuning, particularly with very noisy images. 

Deep Learning: Deep learning methods, particularly Convolutional 
Neural Networks (CNNs), learn complex features and noise patterns 
from data, adapting well to various noise levels. However, they 
require large amounts of labeled data and are computationally 


complex. 
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Patch-Based Methods: Patch-based approaches like Non-Local Patch 
Regression (NPR) are effective for denoising MRI and CT images, 
preserving fine details and structures. However, they are 
computationally intensive and require careful parameter tuning. 
Dictionary Learning: Dictionary learning methods, such as Sparse 
Coding, are adaptive to different noise levels and structures, 
preserving edges and textures. However, they require representative 
training data and are computationally complex. 

Variational Methods: Variational methods like Total Generalized 
Variation (TGV) are robust to noise and outliers, preserving edges and 
fine structures. However, they are computationally complex and 
require parameter tuning. 

Deep Generative Models: Deep generative models like Variational 
Auto Encoders (VAEs) and Generative Adversarial Networks (GANs) 
can generate realistic images and remove noise, but they may suffer 
from training instability and computational complexity. 

Graph-Based Methods: These methods incorporate spatial 
relationships between pixels and are effective for denoising textured 
images. However, modeling dependencies and computational 
complexity are challenges. 

Fuzzy Methods: Fuzzy logic and Fuzzy C-Means Clustering handle 
uncertainty and imprecision in data, modeling complex relationships 
in images. However, they require careful selection of membership 
functions and can be computationally intensive. 

Self-Supervised Learning: These networks are trained on noisy images 
without clean labels, learning robust representations of noise and 
handling various noise levels and types. However, they depend on 
data augmentation and noise modeling, leading to computational 
complexity. 

Attention Mechanisms: Attention-based denoising networks 


dynamically weigh image features, effectively preserving fine details 
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and structures. However, they introduce computational overhead and 


complexity in implementation. 


e Deep Unfolding: Deep unfolding methods adapt to various noise 


models by unfolding 


iterative algorithms 


into neural network 


architectures. However, they require prior knowledge of the denoising 


algorithm and are computationally complex. 


An overview of the classical medical image denoising techniques is 


discussed in Table 1. 


Table 1 . An overview of the classical medical image denoising techniques 


Method Common 

techniques 

Filterin median filter, mean 
g filter, and Gaussian 


filter, Wiener filter 


Transfo Wavelet transform, 


rm Fourier transform 


Advantage 


Compatibility with 


other image 
processing 
techniques 
Preservation of 
image details 
Flexibility and 
adaptability 
Computational 
efficiency 
Multiresolution 
analysis 
Localized noise 
reduction 
Preservation of 
structural 


information 


Disadvantage 


Trade-off between 
noise reduction and 
image blurring 
Blurs the image 
Result in loss of 
resolution 
Sensitivity to 


parameter selection 


Difficulty in 
choosing optimal 
transform 
parameters 
Complexity and 
computation time 
Loss of spatial 


information 
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PCA - Dimensionality 
reduction 
Statistical noise 
modeling 
Preservation of 
global image 


characteristics 


Hybrid - Improved 
denoising 
performance 
Preservation of 


fine details and 


structural 
information 
Non- Exploits 
local redundancies in 
Means natural images - 
(NLM) Preserves textures 


and fine details 


Attentio Attention-based Allows the 

n Denoising Networks network to focus 
Mechan on important 
isms image regions 


during denoising- 
Can learn spatial 


dependencies 


Limited adaptability 
to non-linear noise 
models 
Computational 
complexity 
Loss of spatial 


information: 


Complexity 
increases with 
dimensionality 
Complexity in 

implementation and 


integration 


Computationally 
intensive - 
Sensitivity to 
parameter tuning - 
Limited 
effectiveness with 
high noise levels 
Computational 
overhead due to 
attention 
mechanisms - 
Complexity in 


implementation 


Self- 
Supervi 
sed 


Learnin 


g 


Deep 
Unfoldi 


ng 


Graph- 
Based 
Method 
sS 


Self-Supervised 


Denoising Networks 


Deep Unfolding 


Denoising Networks 


Fuzzy Logic, Fuzzy 


C-Means Clustering 


Graph Cut, Markov 
Random Fields 
(MRFs) 


more effectively 
Trained on noisy 
images without 
requiring clean 
labels - Can learn 
robust 
representations of 
noise - Can handle 
various noise 
levels and types 
Unfolds iterative 
algorithms into 
neural network 
architectures - 
Can adapt to 
various noise 
models 
Handles 
uncertainty and 
imprecision in 
data - Can model 
complex 
relationships in 
images 
Incorporate 
spatial 
relationships 
between pixels- 


Effective for 


denoising textured 


Dependence on data 
augmentation and 
noise modeling - 
Computational 


complexity 


Requires prior 
knowledge of the 
denoising algorithm 
- Computational 


complexity 


Requires careful 
selection of 
membership 
functions - 
Computationally 
intensive 

Complexity in 


modeling 
dependencies - 
Computational 


complexity 
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Deep 
Generat 
ive 
Models 


Variatio 
nal 
Method 
S 
Diction 
ary 
Learnin 


g 


Patch- 
Based 
Method 
S 

Deep 


Learnin 


g 


Block- 
Matchin 
g and 
3D 
Filterin 


g 
(BM3D) 


Variational Auto 
encoders (VAEs), 
Generative 
Adversarial 
Networks (GANs) 
Total Generalized 
Variation (TGV) 


Sparse Coding 
Non-Local Patch 


Regression (NPR) 


Convolutional Neural 
Networks (CNNs) 


images 


Ability to generate 
realistic images 
and remove noise 


- Can learn 
complex image 
distributions 


Robust to noise 


and outliers - 
Preserves edges 
and fine 
structures 
Adaptive to 
different noise 
levels and 
structures in 
images - Preserves 
edges and 
textures 

Effective for 


denoising MRI and 
CT images - 
Preserves fine details 
and structures 


Ability to learn 
complex features and 
noise patterns from 
data - Can adapt to 
various noise levels 


Effective for 
volumetric images 
like CT scans - 
Preserves textures 


and fine details 


Training instability - 
Mode collapse in 
GANSs - 
Computational 
complexity 
Computational 
complexity - 
Requires parameter 
tuning 
Need for 
representative 
training data - 
Computational 
complexity 
Computationally 
intensive - Requires 
careful parameter 


tuning 


Require large amounts 
of labeled data for 
training - 
Computational 
complexity 
Computationally 
intensive - Requires 
careful parameter 
tuning - Limited 
effectiveness with very 


noisy images 
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Anisotr Slow convergence - 


opic Blurs textures and fine 
Diffusi Preserves edges - details - Sensitive to 
TANDAD Robust to noise - 

n Simple parameters 
implementation 

Total Can produce staircase 

Variatio artifacts - Limited 

n (TV) R with 

Denoisi Preserves edges - textured images - 
Buccuye for Sensitive to noise levels 


piecewise constant 
images 


ng 


These techniques have been used for many years and are still used in some 
applications today. However, they have limitations, such as the loss of detail 
and blurring of edges, which can reduce the diagnostic accuracy of the 
image. More advanced denoising techniques, such as deep learning-based 
methods, are being developed to address these limitations and improve the 


quality of denoised medical images. 


4. Deep learning-based methods for medical image 
denoising 


Deep learning-based medical image denoising approaches have gained 
significant attention in recent years due to their ability to effectively remove 
noise and preserve important image features. Advantages of deep learning- 
based methods for medical image denoising include: 

1. Improved accuracy: Deep learning-based methods have shown to improve 
the accuracy of medical image denoising compared to classical methods. 

2. Robustness: Deep learning-based methods are able to handle noisy and 
complex medical images with high levels of accuracy and robustness. 

3. Automation: Once the model is trained, it can be used to denoise images 


automatically, without the need for manual intervention. 
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4. Generalization: Deep learning-based methods can generalize to different 
types of medical images and noise levels. 

However, there are also some limitations to deep learning-based methods 
for medical image denoising, such as: 

1. Data dependency: Deep learning-based methods require large amounts of 
high-quality training data to achieve optimal performance. 

2. Interpretability: Deep learning-based methods are often considered as 
"black boxes" because it can be difficult to interpret how the model is 
making its decisions. 

3. Overfitting: Deep learning-based models can overfit to the training data, 
meaning they may not generalize well to new, unseen data. 

4. Computationally intensive: Deep learning-based methods can be 
computationally intensive and require powerful hardware to train and 
deploy. 

Here is an overview of some of the most popular deep learning-based 
medical image denoising approaches: 

e Convolutional Neural Network (CNN) Denoising [27]: CNN-based 
denoising methods have been widely used for medical image 
denoising. They use a deep neural network to learn a mapping 
between noisy and clean images. These methods have shown 
promising results for different types of medical images, including 
MRI, CT, and PET. 

e Autoencoder-based Denoising [28]: Autoencoder-based denoising 
methods use an encoder-decoder architecture to learn a low- 
dimensional representation of noisy images. The decoder then 
generates a denoised image from this representation. These methods 
have been shown to be effective for denoising medical images, 
especially for low-dose CT scans. 

e Generative Adversarial Network (GAN) Denoising [29]: GAN-based 
denoising methods use a generator network to create denoised 


images and a discriminator network to distinguish between the 
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generated images and the ground truth images. These methods have 
shown promising results for medical image denoising, especially for 
MRI. 

VariationalAutoencoder (VAE) Denoising [30]: VAE-based denoising 
methods use a probabilistic model to learn a low-dimensional 
representation of noisy images. The model generates denoised images 
by sampling from this representation. These methods have shown 
promising results for denoising PET images. 

Deep Residual Learning (DRL) Denoising: DRL-based denoising 
techniques leverage residual learning to effectively capture noise 
patterns and reconstruct clean images. These methods excel in 
handling complex noise patterns and have demonstrated effectiveness 
in denoising MRI, CT, and ultrasound images. 

Attention Mechanism Denoising: Denoising methods incorporating 
attention mechanisms dynamically weigh image features during the 
denoising process, leading to improved preservation of important 
details. These methods have shown promising results in denoising 
various medical images, including MRI, CT, and PET. 

Self-Supervised Learning Denoising: Self-supervised learning-based 
denoising approaches train on noisy images without clean labels, 
learning robust representations of noise. These methods are effective 
in handling various noise levels and types in medical images like MRI, 
CT, and ultrasound. 

Deep Unfolding Denoising: Deep unfolding denoising methods unfold 
iterative algorithms into neural network architectures, allowing 
adaptation to different noise models. They have shown effectiveness in 
denoising MRI, CT, and PET images. 

Attention-Based Methods Denoising: Attention-based denoising 
methods dynamically weigh image features, effectively preserving fine 


details and structures in medical images like MRI, CT, and PET. 
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e Multi-Task Linear Function Networks Denoising: Multi-task linear 


function networks jointly learn multiple denoising tasks, offering 


transfer learning capabilities and efficient use of shared information 


across tasks. They have shown effectiveness in denoising various 


medical images, including MRI, CT, and ultrasound. 


An overview of the deep learning-based medical image denoising techniques 


is discussed in Table 2. 


Table 2 . An overview of deep learning-based medical image denoising techniques 


Method Commo Advantage 
n 
technig 
ues 
CNN Parallel processing 
capabilities 
Ability to capture spatial 
information 
Adaptability to various 
noise types 
Scalability and 
generalization 
Autoencode Unsupervised learning 
r Adaptability to various 
noise types 
Transfer learning and 


fine-tuning 


GAN Generation of realistic 


and high-quality denoised 


Disadvantage 


Computational 
complexity 
Overfitting 

Interpretability 


Sensitivity to hyper 
parameters 
Loss of fine details 
Difficulty in 
capturing complex 


noise patterns 


Difficulty in training 
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images and instability 


Preservation of fine Lack of control over 
details and textures denoising process 
Transfer learning and Computational 
fine-tuning complexity 
VAE Probabilistic framework Blurring of fine 
Latent space details 
representation Difficulty in 
Adaptability to different capturing complex 
noise types noise patterns 
Trade-off between 
reconstruction and 
regularization 
Deep Effective in learning Increased model 
Residual residual information - complexity- May 
Learning Handles vanishing require longer 
(DRL) gradient problem training time - 
effectively - Improved Interpretability 
convergence speed challenges 
Attention Ability to focus on Computational 
Mechanism relevant image regions overhead due to 
Ss during denoising - attention 
Improved performance in mechanisms- 
preserving important Complexity in 
features implementation 
Self- Trained on noisy images Dependence on data 
Supervised without clean labels - Can augmentation and 
Learning learn robust noise modeling - 
representations of noise - Computational 


Handles various noise 
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levels and types complexity 


Deep Unfolds iterative Requires prior 
Unfolding algorithms into neural knowledge of the 
network architectures - denoising algorithm - 
Can adapt to various Computational 
noise models complexity 
Attention- Ability to dynamically Computational 
Based weigh image features overhead due to 
Methods during denoising - attention 
Effective in preserving mechanisms - 
fine details and structures Complexity in 
implementation 
Multi-Task Ability to jointly learn Increased model 
Linear multiple denoising tasks - complexity - 
Function Transfer learning Sensitivity to task 
Networks capabilities - Efficient use dependencies - Need 
of shared information for diverse training 
across tasks data 


In the following, a number of states of the arts articles that have used deep 
learning for medical images denoising have been reviewed. 

Paper [31] proposes a new approach for medical image denoising using a 
complex-valued convolutional neural network (CV-CNN). The proposed CV- 
CNN uses complex-valued filters to capture both the magnitude and phase 
information of the input image, which is important for preserving the image 
features. The CV-CNN is trained using a complex-valued loss function, and 
the experimental results show that the proposed method outperforms 
classical real-valued CNNs and other state-of-the-art denoising methods in 
terms of both quantitative and qualitative evaluations. The proposed 
method has the potential to improve the accuracy and efficiency of medical 


image denoising, leading to better patient outcomes and improved clinical 
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practice. This approach is able to capture both the magnitude and phase 
information of the input image, which is important for preserving the image 
features. The limitation of approach is may require more computational 
resources than classical real-valued CNNs due to the use of complex-valued 
filters. Paper [32] proposes a novel denoising method for medical CT images 
using a U-Net and multi-attention mechanism. The method incorporates 
three attention modules to extract different feature information from the 
images. Additionally, an enhancement learning module is introduced to 
merge the feature maps and retain detail information. The proposed method 
is evaluated on two datasets and compared with state-of-the-art methods, 
demonstrating its superior performance. Ablation experiments are 
conducted to verify the effectiveness of each attention module. The paper is 
organized into sections covering background, related work, methodology, 
experimental results, and conclusion. The code for this study is publicly 
available on GitHub. 

Advantages of deep learning-based methods for medical image denoising 
include their ability to learn and adapt to different types of noise and their 
potential to improve image quality. However, limitations include the need 
for large amounts of training data and the potential for overfitting to the 
training data. Paper [33] presents the Self-Supervised Guided Knowledge 
Distillation (SGKD) framework, which is an unsupervised learning approach 
that utilizes self-supervised learning results to guide knowledge distillation. 
The framework includes a self-supervised cycle network that generates 
paired training data from unpaired LDCT and NDCT images. The knowledge 
distillation process combines an improved pure convolutional neural 
network Unet with a pure transformer Swin-Unet to enable complementary 
learning of high- and low-frequency information. Overall, the contributions 
of this paper include the SGKD framework, the self-supervised cycle 
network, and the network backbone for knowledge distillation.The objective 
of paper [34] is to conduct a qualitative and quantitative evaluation of 1.5 T 


brain images using deep learning-based reconstruction (dDLR) algorithm 
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and compare them to the original 1.5 T images as well as 3 T images.The 
paper [35] presents several significant contributions. Firstly, a novel 
evolutionary model is proposed, which utilizes Differential Evolution (DE) to 
find optimal CNN architectures and hyper parameters for medical image 
denoising. This approach simplifies the model by considering CNN hyper 
parameters as vector parameters in the evolutionary process, leading to 
state-of-the-art performance. Secondly, the model automates the learning 
process by automatically determining the optimal network structures using 
DE, eliminating the need for manual intervention. Additionally, the search 
Space is dynamically updated using transfer learning techniques, which 
accelerates the optimization process. 


Table 3: Categorization of Medical Image Denoising 
Methods. 


Categor Methods Advantages Disadv Applications 
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Deep Deep Models long- High Denoising 
Learnin Convoluti range comple low-dose CT 
g onal dependencies, xity, images 
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Network denoising comput 

with performance ational 

Attention deman 
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Categor 
y 


Novel 
and 
Combin 
ed 


Methods 


Deep 
Learning 
and 
Wavelet 
Transfor 


m 


Method Descriptions 


@ Deep Convolutional Neural Network with Attention Blocks (DCAN): 
This method utilizes a deep convolutional neural network with attention 
blocks to model long-range dependencies between pixels in low-dose CT 
images. It effectively removes noise and improves denoising performance. 
However, it introduces high complexity and computational demands. [41] 

© U-Net with Dense Blocks and Attention Mechanism: This method 
employs a U-Net architecture with dense blocks and an attention 
mechanism to preserve structural details and remove noise from MRI 


images. It effectively removes noise while preserving edges and textures 


Advantages 


but requires extensive training. [42] 


© Attention-based Deep 


Neural Network: This method utilizes an 


Disadv 


antages 


Applications 


attention-based deep neural network to remove noise from ultrasound 
images. It effectively removes noise while preserving fine details but is 
sensitive to noise patterns. [46] 

Variational Autoencoder with Deep Convolutional Neural Network: 
This method combines variational autoencoder techniques and a deep 
convolutional neural network to remove noise from various medical 
images. It effectively removes noise and provides accurate uncertainty 
estimation but introduces high complexity and computational demands. 
[43] 


Knowledge-based 


Knowledge-guided Denoising with Anatomical Information: This 
method leverages anatomical information to identify and preserve 
important anatomical structures in brain CT images during noise removal. 
It effectively removes noise while accurately preserving anatomical 
structures but requires accurate anatomical knowledge. [50] 

Patch-based Denoising with Anatomical Constraints: This method 
utilizes anatomical information to guide patch-based denoising in cardiac 
MRI images. It effectively removes noise while preserving the fine details 


of cardiac tissue but introduces high processing time. [48] 


Combined 


Deep Learning and Knowledge-guided Denoising (cont.): This 
method combines deep learning and knowledge-guided denoising to 
remove noise from low-dose CT lung images. It effectively removes noise 
while accurately preserving anatomical structures but may introduce 
increased computational complexity. [47] 
Deep Convolutional Neural Network with Attention Blocks and 
Attention Mechanism (cont.): This method combines a deep 
convolutional neural network with attention blocks and an attention 
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mechanism to extract features and remove noise from various medical 
images. It effectively removes noise while preserving fine details, 
particularly in images with complex structures but may introduce 


increased computational complexity. [49] 
Fast and Efficient 


e Lightweight Convolutional Neural Network with Attention 
Mechanism: This method utilizes a lightweight convolutional neural 
network with an attention mechanism to remove noise from ultrasound 
images on mobile devices in real-time. It effectively removes noise while 
maintaining high processing speed but may introduce trade-offs between 


denoising performance and computational efficiency. [44] 


© Compressed Sensing-based Denoising with Deep Convolutional 
Neural Network: This method combines compressed sensing techniques 
and a deep convolutional neural network to efficiently remove noise from 
large medical images. It effectively removes noise while consuming less 
memory and processing time compared to traditional methods but may 
introduce trade-offs between denoising performance and computational 


efficiency. [45] 
Novel and Combined 


@ Deep Learning and Wavelet Transform: This method combines deep 
learning and wavelet transform to remove noise from medical images. 
Deep learning is used to extract features from the images, and wavelet 
transform is used to remove noise. This method effectively removes noise 
while preserving fine details but may introduce increased computational 
complexity. [51] 

© Deep Learning and Complex-Valued Convolutional Neural 
Network: This method combines deep learning and a complex-valued 


convolutional neural network to remove noise from medical images. Deep 
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learning is used to extract features from the images, and a complex- 
valued convolutional neural network is used to remove noise. This method 
effectively removes noise from medical images, particularly images with 
complex structures but may introduce increased computational 
complexity. [48] 

@ Deep Learning and Recurrent Neural Network: This method 
combines deep learning and a recurrent neural network to remove noise 
from medical images. Deep learning is used to extract features from the 
images, and a recurrent neural network is used to remove noise. This 
method effectively removes noise from medical images, particularly 
images with dynamic structures but may introduce increased 
computational complexity. [45] 

© Al-based Denoising: This method utilizes artificial intelligence to learn 
noise patterns in medical images and remove them. AI can more 
accurately identify noise patterns and remove them more effectively but 
requires large amounts of training data and may introduce challenges in 


interpretability and explainability. [48] 


5. Evaluation metrics for medical image denoising 


Here are some commonly used evaluation metrics for medical image 
denoising[36-40]: 
1. Peak Signal-to-Noise Ratio (PSNR): PSNR measures the difference 
between the original image and the denoised image based on the 
mean squared error (MSE) between them. The higher the PSNR, the 


closer the denoised image is to the original image. 


MAX?’ 


MSE Where: 


PSNR=10-log,, 


e MAX represents the maximum possible signal value (typically 255 for 
8 -bit images). 
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e MSE is the mean squared error between the original and denoised 
images. 


2. Structural Similarity Index (SSIM): SSIM measures the structural 
similarity between the original image and the denoised image. It takes 
into account the luminance, contrast, and structure of the image and 
ranges from -1 to 1, with 1 indicating perfect similarity. 

_ [2 HxByt C2094 G) 


SS. , 
ed rte ees 


Where: 


e x and y denote the original and denoised images, respectively. 
* w, and 4, are the means of images x and y, respectively. 

e œ and o, are the variances of images x and y, respectively. 

e „is the covariance between x and y. 


e CC, and C, are small constants to prevent division by zero. 


3. Mean Absolute Error (MAE): MAE measures the average absolute 
difference between the original image and the denoised image. The 


lower the MAE, the closer the denoised image is to the original image. 


MAE=—-5" Olx,-y, 
i=1 


Where x; and y; represent pixel values in the original and denoised 


images, respectively, and n is the size of the images. 


4. Mean Square Error (MSE): MSE measures the average squared 
difference between the original image and the denoised image. The 


lower the MSE, the closer the denoised image is to the original image. 
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MSE=İ 5 O(x,-y,|° 
nizi 
Again, X; and y, represent pixel values in the original and denoised 


images, respectively. 


5. Area Under the Curve (AUC): It measures the area under the Receiver 
Operating Characteristic (ROC) curve and provides a measure of the 
model's performance in a binary classification problem. 

6. Intersection over Union (IoU): It measures the overlap between the 
predicted and actual regions of interest in an object detection 
problem. 


Joy- intersection Area 
Union Area 


Where the intersection and union areas of predicted and ground truth 


regions are calculated. 


When comparing different medical image denoising methods, it is important 
to evaluate their performance using appropriate metrics. Here is an 
example of how different metrics can be used to compare the performance 
of two denoising methods: 

e Method A: Wavelet-based denoising 

e Method B: PCA-based denoising 
Metrics used for comparison: 
1. Peak Signal-to-Noise Ratio (PSNR): Method A achieved a PSNR of 35 dB, 
while Method B achieved a PSNR of 33 dB. This indicates that Method A 
produced denoised images that were closer to the original images than 
Method B. 
2. Structural Similarity Index (SSIM): Method A achieved an SSIM of 0.95, 
while Method B achieved an SSIM of 0.92. This indicates that Method A 
produced denoised images that were more structurally similar to the 


original images than Method B. 
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3. Mean Absolute Error (MAE): Method A achieved an MAE of 0.02, while 
Method B achieved an MAE of 0.04. This indicates that Method A produced 
denoised images that had lower average absolute differences from the 
original images than Method B. 

4. Mean Square Error (MSE): Method A achieved an MSE of 0.01, while 
Method B achieved an MSE of 0.03. This indicates that Method A produced 
denoised images that had lower average squared differences from the 
original images than Method B. 

Based on these metrics, Method A appears to be the better denoising 
method as it produced denoised images that were closer to the original 
images in terms of PSNR, SSIM, MAE, and MSE. However, it is important to 
note that different metrics may be more appropriate for different types of 
medical images and noise levels, and that the choice of metric should be 
based on the specific requirements of the application. 

While current evaluation metrics for medical image denoising are useful for 
comparing different denoising methods, they have some limitations that 
should be considered: 

1. Lack of correlation with clinical outcomes: While evaluation metrics such 
as PSNR, SSIM, MAE, and MSE are useful for quantifying the difference 
between the original image and the denoised image, they do not necessarily 
correlate with clinical outcomes. For example, a denoising method may 
achieve high PSNR and SSIM values, but may not improve the accuracy of a 
diagnostic task. Therefore, it is important to also evaluate the clinical 
impact of denoising methods. 

2. Dependence on image quality: Evaluation metrics are highly dependent 
on the quality of the original image and the amount of noise present in the 
image. Therefore, the same denoising method may perform differently on 
different types of images or at different noise levels. 

3. Lack of standardization: There is currently no standardization of 


evaluation metrics for medical image denoising. Different studies may use 
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different metrics, making it difficult to compare the performance of different 
denoising methods. 

4. Limited evaluation of real-world scenarios: Many evaluation metrics are 
based on the assumption that the noise in the image is additive and 
Gaussian. However, in real-world scenarios, the noise may be more complex 
and may have different statistical properties. Therefore, it is important to 
evaluate denoising methods in a variety of realistic scenarios. 

5. Difficulty in evaluating multi-modal images: Many medical images are 
multi-modal, meaning that they are generated using different imaging 
modalities. Evaluating denoising methods for multi-modal images is 
challenging, as there is no single metric that can be used to compare the 
performance of different denoising methods. 

Overall, while evaluation metrics are useful for comparing different 
denoising methods, they should be used in conjunction with clinical 
outcomes and evaluated in a variety of real-world scenarios to ensure that 


they are effective in improving diagnostic accuracy and patient outcomes. 
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Noisy Image 


Post Processing 


Denoising 


Fig1: An example of the stages of medical image noise reduction. 


The original image after applying initial parameters and adding 


noise, followed by the detection of the type of noise and the 


application of appropriate filters for each type of noise, and 


ultimately, the resulting denoised image. 
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Fig2 : Evaluation Criteria for Sample fig1. 
The evaluation parameters for the image shown in this figure 


include various image evaluation methods such as PSNR (Peak 
Signal-to-Noise Ratio), SSIM (Structural Similarity Index), MAE 
(Mean Absolute Error), MSE (Mean Squared Error), AUC (Area 


Under the Curve), and IoU (Intersection over Union), which 


indicate the performance of denoising. 
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6. Conclusion and future direction medical image 
denoising 


Medical image denoising is an essential step in improving the accuracy of 
medical diagnosis and treatment. However, there are several challenges 
that need to be addressed to enhance the effectiveness of denoising 
methods. Some of the current challenges in medical image denoising 
include handling complex noise models, preserving important image 
features such as edges, textures, and structures, and adapting to different 
imaging modalities and clinical scenarios. Additionally, obtaining ground 
truth data for medical images can be challenging due to ethical and 
practical considerations, and real-time processing is required in many 
medical applications. Denoising should be integrated with other image 
processing tasks such as segmentation, registration, and classification to 
improve the accuracy of medical diagnosis and treatment. 

There are several opportunities for future research in medical image 
denoising, some of which are: 

1. Development of deep learning-based denoising methods: Deep learning 
has shown promising results in various image processing tasks, including 
denoising. Future research can focus on developing deep learning-based 
denoising methods that can handle complex noise models and preserve 
important image features. 

2. Integration of denoising with other image processing tasks: Denoising is 
often just one step in a larger image processing pipeline. Future research 
can focus on integrating denoising with other tasks such as segmentation, 
registration, and classification to improve the accuracy of medical diagnosis 
and treatment. 

3. Real-time denoising: In many medical applications, such as real-time 
image-guided interventions, denoising needs to be performed in real-time. 
Future research can focus on developing denoising methods that are fast 


and efficient, and can be implemented in real-time. 
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4. Multi-modal image denoising: Many medical images are multi-modal, 
meaning that they are generated using different imaging modalities. Future 
research can focus on developing denoising methods that can handle these 
different modalities and preserve the unique features of each modality. 

5. Evaluation of denoising methods using clinical outcomes: While 
evaluation metrics such as PSNR and SSIM are useful for comparing 
different denoising methods, they do not necessarily correlate with clinical 
outcomes. Future research can focus on evaluating denoising methods 
using clinical outcomes to ensure that they are effective in improving 
diagnostic accuracy and patient outcomes. 

6. Development of benchmark datasets: In order to evaluate and compare 
denoising methods, benchmark datasets are required. Future research can 
focus on developing benchmark datasets that are representative of different 
imaging modalities and clinical scenarios. 

7. Ethical considerations: Medical image denoising requires the use of 
patient data. Future research can focus on addressing ethical 
considerations related to the use of patient data in denoising research. 

The development of effective medical image denoising methods has 
important implications for medical imaging and clinical practice. Denoising 
can lead to improved diagnostic accuracy, reduced radiation exposure, 
improved image-guided interventions, improved efficiency, improved patient 
comfort, and improved quality of life for patients. Overall, the development 
of effective medical image denoising methods has the potential to improve 
the accuracy and efficiency of medical imaging, reduce radiation exposure, 
and improve patient comfort and quality of life, leading to better patient 


outcomes and improved clinical practice. 
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